The Reliability of Peer Reviews of Papers on Information Systems
نویسندگان
چکیده
This paper analyses the reliability of the double-blind peer review systems used for submissions to the 2001 and 2002 UK Academy for Information Systems (UKAIS) conferences. The level of reliability found in the first conference was marginally lower than would be expected from a model based on chance. In the second conference the reliability level was significantly better, but still low. The paper explores some of the implications of this for the reviewing system, and suggests a model for assessing the impact of low levels of reliability.
منابع مشابه
Guest Editorial: Impact of Integrated Intelligent Information and Analytical Systems on Society
The Special Issue of the Journal of Information Technology Management (JITM) is publishing very selective papers on information management, technology in higher education, integrated systems, enterprise management, cultural thoughts, strategic contributions, management information systems, and cloud computing. We received numerous papers for this special issue but after an extensive pe...
متن کاملTaxonomy of Global Air Transport
Data from the United Nations and the International Civil Aviation Organization Information Systems were used as a base for characterizing, classifying and comparing air transport demand and supply features of 156 countries. Relevant data from 1980 were chosen to reflect five sets of characteristics namely, air transport, 50cm-economic status, population demography, geographical and environmenta...
متن کاملPerformance Evaluation of Medical Image Retrieval Systems Based on a Systematic Review of the Current Literature
Background and Aim: Image, as a kind of information vehicle which can convey a large volume of information, is important especially in medicine field. Existence of different attributes of image features and various search algorithms in medical image retrieval systems and lack of an authority to evaluate the quality of retrieval systems, make a systematic review in medical image retrieval system...
متن کاملEvaluating researches on urban housing indicators in current decade based on PRISMA method
Considering important role of housing in contemporary urban areas, evaluating urban housing quality has become one of the most popular topics in recent researches. Housing has vast conceptual perspectives which include many aspects of urban life beside the dwelling purpose of it, such as recreation, primary schools, and play yards and so on. The most efficient tool for achieving such purposes i...
متن کاملReporting of Financial and Non-financial Conflicts of Interest in Systematic Reviews on Health Policy and Systems Research: A Cross Sectional Survey
Background Systematic reviews are increasingly used to inform health policy-making. The conflicts of interest (COI) of the authors of systematic reviews may bias their results and influence their conclusions. This may in turn lead to misguided public policies and systems level decisions. In order to mitigate the adverse impact of COI, scientific journals require authors to disclose their COIs. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- J. Information Science
دوره 30 شماره
صفحات -
تاریخ انتشار 2004